Adaptive Dimensional Gaussian Mutation of PSO-Optimized Convolutional Neural Network Hyperparameters

نویسندگان

چکیده

The configuration of the hyperparameters in convolutional neural networks (CNN) is crucial for determining their performance. However, traditional methods hyperparameter configuration, such as grid searches and random searches, are time consuming labor intensive. optimization CNN a complex problem involving multiple local optima that poses challenge particle swarm (PSO) algorithms, which prone to getting stuck achieving suboptimal results. To address above issues, we proposed an adaptive dimensional Gaussian mutation PSO (ADGMPSO) efficiently select optimal configurations. ADGMPSO algorithm utilized cat chaos initialization strategy generate initial population with more uniform distribution. It combined sine-based inertia weights asynchronous change learning factor balance global exploration exploitation capabilities. Finally, elite was improve diversity convergence accuracy at different stages evolution. performance compared five other evolutionary including PSO, BOA, WOA, SSA, GWO, on ten benchmark test functions, results demonstrated superiority terms value, mean standard deviation. then applied LeNet-5 ResNet-18 network models. MNIST CIFAR10 datasets showed achieved higher generalization ability than PSO-CNN, LDWPSO-CNN, GA-CNN.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hyperparameters Optimization in Deep Convolutional Neural Network / Bayesian Approach with Gaussian Process Prior

Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and performance are totally reliant on the hyperparameters. This multilayered architecture parameterized by a set of hyperparameters such as the number of convolu...

متن کامل

A Convolutional Neural Network based on Adaptive Pooling for Classification of Noisy Images

Convolutional neural network is one of the effective methods for classifying images that performs learning using convolutional, pooling and fully-connected layers. All kinds of noise disrupt the operation of this network. Noise images reduce classification accuracy and increase convolutional neural network training time. Noise is an unwanted signal that destroys the original signal. Noise chang...

متن کامل

PSO optimized Feed Forward Neural Network for offline Signature Classification

The paper is based on feed forward neural network (FFNN) optimization by particle swarm intelligence (PSI) used to provide initial weights and biases to train neural network. Once the weights and biases are found using Particle swarm optimization (PSO) with neural network used as training algorithm for specified epoch, the same are used to train the neural network for training and classificatio...

متن کامل

STLF Based on Optimized Neural Network Using PSO

The quality of short term load forecasting can improve the efficiency of planning and operation of electric utilities. Artificial Neural Networks (ANNs) are employed for nonlinear short term load forecasting owing to their powerful nonlinear mapping capabilities. At present, there is no systematic methodology for optimal design and training of an artificial neural network. One has often to reso...

متن کامل

A Two-Dimensional Convolutional Neural Network for Brain Tumor Detection From MRI

Aims: Cancerous brain tumors are among the most dangerous diseases that lower the quality of life of people for many years. Their detection in the early stages paves the way for the proper treatment. The present study aimed to present a two-dimensional Convolutional Neural Network (CNN) for detecting brain tumors under Magnetic Resonance Imaging (MRI) using the deep learning method. Methods & ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2023

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app13074254